Learning Heterogeneous Hidden Markov Random Fields
نویسندگان
چکیده
Hidden Markov random fields (HMRFs) are conventionally assumed to be homogeneous in the sense that the potential functions are invariant across different sites. However in some biological applications, it is desirable to make HMRFs heterogeneous, especially when there exists some background knowledge about how the potential functions vary. We formally define heterogeneous HMRFs and propose an EM algorithm whose M-step combines a contrastive divergence learner with a kernel smoothing step to incorporate the background knowledge. Simulations show that our algorithm is effective for learning heterogeneous HMRFs and outperforms alternative binning methods. We learn a heterogeneous HMRF in a real-world study.
منابع مشابه
Heterogeneous Web Data Extraction Algorithm Based On Modified Hidden Conditional Random Fields
As it is of great importance to extract useful information from heterogeneous Web data, in this paper, we propose a novel heterogeneous Web data extraction algorithm using a modified hidden conditional random fields model. Considering the traditional linear chain based conditional random fields can not effectively solve the problem of complex and heterogeneous Web data extraction, we modify the...
متن کاملJoint semi-supervised learning of Hidden Conditional Random Fields and Hidden Markov Models
متن کامل
Clustering Heterogeneous Data with Mutual Semi-supervision
We propose a new methodology for clustering data comprising multiple domains or parts, in such a way that the separate domains mutually supervise each other within a semi-supervised learning framework. Unlike existing uses of semi-supervised learning, our methodology does not assume the presence of labels from part of the data, but rather, each of the different domains of the data separately un...
متن کاملHidden Conditional Neural Fields for Continuous Phoneme Speech Recognition
In this paper, we propose Hidden Conditional Neural Fields (HCNF) for continuous phoneme speech recognition, which are a combination of Hidden Conditional Random Fields (HCRF) and a MultiLayer Perceptron (MLP), and inherit their merits, namely, the discriminative property for sequences from HCRF and the ability to extract non-linear features from an MLP. HCNF can incorporate many types of featu...
متن کاملMouse Movement and Probabilistic Graphical Models Based E-Learning Activity Recognition Improvement Possibilistic Model
Automatically recognizing the e-learning activities is an important task for improving the online learning process. Probabilistic graphical models such as Hidden Markov Models and Conditional Random Fields have been successfully used in order to identify a web user activity. For such models, the sequences of observation are crucial for training and inference processes. Despite the efficiency of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- JMLR workshop and conference proceedings
دوره 33 شماره
صفحات -
تاریخ انتشار 2014